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DETAILED ACTION 
Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

2. Claims 1, 3-5, 8, 12, 14-16, 19, 21, 23, 25, 27, 32, 34, 35, 37, 38-40, and 50 are 
rejected under 35 U.S.C. 102(b) as being anticipated by Chen (4,613,942). 

Chen discloses a method of programming a device, the method comprising: 
providing a plurality of card-like objects (col. 4, lines 32-33), where at least one surface 
of the card-like objects includes indicia (col. 3, line 2), wherein at least a portion of the 
indicia is machine readable and at least a portion is human recognizable (col. 4, lines 
35-38); visually recognizing the indicia on at least some of the card-like objects using an 
image recognition process (col. 4, lines 42-44); associating the recognized indicia with 
one or more executable program instructions (col. 3, lines 29-32); and arranging the one 
or more executable program instructions to create at least a portion of a computer 
program for control of the device (col. 4, lines 45-51); Chen further discloses wherein 
the device that is controlled corresponds to a mobile robot, wherein control includes 
mobility of the mobile robot (Column 3, lines 35-49; Column 5, lines 6-13) 

As per claims 3-5, Chen discloses a digital camera to detect visual features of 
the card-like objects, where the camera views the card-like objects without touching the 
card-like objects is the equivalent of the camera (14), digital image processor (15), and 
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computer (16) disclosed by Chen (as evidenced by The Free On-line Dictionary of 
Computing, see paragraph 6 of this Office Action). Chen discloses an optical scanner 
via scanning images (see Fig. 10B) to recognize the one or more card-like objects, 
where the optical scanner recognizes the one or more card-like objects without touching 
the objects as shown in figure 1 where a schematic view of the invention shows indicia 
being scanned from a distance. Chen discloses indicia that comprise of both graphical 
(75a-e and 77a-e) markings and textual (76a-e) symbols (col. 4, lines 40-44). 

As per claim 8, Chen discloses a portion of a computer program that comprises 
at least one of a complete program, a macro, and a sub-routine (col. 2, lines 58-61). 

As per claim 12, Chen discloses a method of programming a device, the method 
comprising: visually recognizing indicia that are visible on at least one surface of one or 
more planar objects, where at least one surface of the planar objects includes indicia, 
where at least a portion of the indicia is machine readable and at least a portion is 
human recognizable (col. 4, lines 35-38); automatically associating at least some of the 
recognized indicia with one or more executable program instructions (col. 3, lines 29- 
32); and arranging the one or more executable program instructions to create at least a 
portion of a computer program for the device for control of the device (col. 4, lines 45- 
51); Chen further discloses wherein the device that is controlled corresponds to a 
mobile robot, wherein control includes mobility of the mobile robot (Column 3, lines 35- 
49; Column 5, lines 6-13) 

As per claims 14-16, Chen discloses receiving data from a digital camera to 
detect visual features of the planar objects, where the camera views the planar objects 
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without contacting the planar objects is the equivalent of the camera (14), digital image 
processor (15), and computer (16) disclosed by Chen (as evidenced by The Free On- 
line Dictionary of Computing, see paragraph 6 of this Office Action). Chen discloses an 
optical scanner via scanning images (see Fig. 10B) to recognize the one or more card- 
like objects, where the optical scanner recognizes the one or more card-like objects as 
shown in figure 1 where a schematic view of the invention shows indicia being scanned 
from a distance. Chen discloses indicia that comprise of both graphical (75a-e and 77a- 
e) markings and textual (76a-e) symbols (col. 4, lines 40-44). 

As per claim 19, Chen discloses a portion of a computer program comprises at 
least one of a complete program, a macro, and a sub-routine (col. 2, lines 58-61). 

As per claim 21, Chen discloses associating at least some of the recognized 
indicia with one or more commands, where the commands are related to control of a 
programming environment (col. 3, lines 29-32). 

As per claim 23, Chen discloses a method of controlling a machine, the method 
comprising: visually observing indicia that are visible on at least a surface of an object, 
where the indicia are at least partially machine readable and at least partially human 
recognizable, where at least some of the indicia is associated with a desired behavior 
for the machine (col. 4, lines 35-38); associating the recognized indicia with 
corresponding behavior based at least in part on data retrieved from a data store (col. 3, 
lines 29-32); and controlling a behavior of the machine according to the recognized 
indicia (col. 4, lines 45-51); Chen further discloses wherein the machine corresponds to 
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a mobile robot, wherein at least a portion of the behavior that is controlled includes 
mobility of the mobile robot (Column 3, lines 35-49; Column 5, lines 6-13) 

As per claim 25, Chen discloses a card-like object (col. 4, lines 32-33). 

As per claim 27, Chen discloses visually observing a plurality of indicia on a 
plurality of objects; associating the plurality of indicia with a plurality of desired 
behaviors; arranging the plurality of desired behaviors in an order according to a visually 
observed arrangement of the corresponding plurality of objects; and controlling the 
behavior of the machine according to the order (col. 4, lines 32-51). 

As per claim 32, Chen discloses indicia that are machine readable and a portion 
of the indicia that are human recognizable are on a same surface of the object (col. 4, 
lines 40-44). 

As per claim 34, Chen discloses a portion of the indicia that are human 
recognizable corresponds to one or more words written in plain text (76a-e). 

As per claims 35, 37, 38, 40, 50, Chen discloses a set of one or more cards with 
indicia associated with operators, flow control, actions for a computer and commands. 
Further, each card has a portion comprising graphical indica and a portion comprising 
computer-readable instructions. (Column 4, lines 28-56) 

As per claim 39, Chen discloses wherein the indicia associated with the actions 
correspond to actions for control of a mobile device (Column 5, lines 6-13). 

3. A digital camera is a camera that captures and stores still images as digital data 
instead of on photographic film (digital camera, (n.d.). The Free On-line Dictionary of 
Computing. Retrieved February 01, 2007, from Dictionary.com website: 
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http://dictionarv.reference.com/browse/digital camera) . An optical scanner is a device 
that converts printed images and text into digital information that can be edited, 
transmitted, and stored (optical scanner, (n.d.). The American Heritage® Science 
Dictionary. Retrieved February 01, 2007, from Dictionary.com website: 
http://dictionarv.reference.com/browse/optical scanner) . The camera (14), digital image 
processor (15), and computer (16) disclosed by Chen is the equivalent of a digital 
camera and an optical scanner. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 6, 17, 20, 28, and 31 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen (4,613,942), in view of Lawton et al. (5,832,100). 

Although Chen discloses all the claimed elements as mentioned in claims 1, 12, 
and 23, Chen fails to disclose the card-like objects being formed at least in part from 
paper, and the card-like objects are not affixed to other objects; Chen also fails to 
disclose that the portion that is machine readable and the portion that is human 
recognizable are the same; and Chen fails to disclose indicia that have been correctly 
identified by visually observing consistent data for indicia. 
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Lawton in the same field of invention discloses a method, wherein the card-like 
objects are formed at least in part from paper, and the card-like objects are not affixed 
to other objects (col. 3, lines 37-41). Lawton further discloses the portion that is machine 
readable and the portion that is human recognizable are the same (col. 8, lines 10-12) 
and verifying that the indicia have been correctly identified by visually observing 
consistent data for indicia (col. 8, lines 1-3). 

From this teaching of Lawton, it would have been obvious to one having ordinary 
skill in the art at the time the invention was made to modify the method of programming 
and controlling a device of Chen to include forming card-like objects at least in part from 
paper, not affixing the card-like object to other objects, having the same indicia being 
recognizable to human and machine, and verifying that the indicia have been correctly 
identified by visually observing consistent data for indicia as taught by Lawton in order 
to convert information on paper documents into valid, computer-readable text (Lawton 
col. 3, lines 37-41). 

6. Claims 7, 9, 10, 18, 26, 29, and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen (4,613,942), in view of Luebbert (Communications of the ACM, 
Volume 7, Issue 12). 

Although Chen discloses all the claimed elements as mentioned in claims 1, 12, 
and 23, Chen fails to disclose a card-like object corresponds to programming 
commands and tokens and not associated to a product code or contents of a product. 

Luebbert in the same field of invention discloses a method, wherein a card-like 
object corresponds to at least one of a token card and a command card inherently 
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shown in the programming cards in figures 1-4. Luebbert also inherently discloses in 
figure 3 associating the recognized indicia with one or more commands, where the 
commands control a programming environment and are not incorporated into an 
executable program and automatically executing the one or more associated 
commands to control the program as evidenced by the programming language Fortran 
that card is used the program a subset of. Luebbert also discloses in the article 
inherently in the cards in figures 1-4 commands and command parameters to at least 
partially control the behavior of a programming system machine. Further, Luebbert 
does not associate indicia with a product code and indicia are not associated with an 
identification of a content of an object. 

From this teaching of Luebbert, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to modify the method of 
programming and controlling a device of Chen to include a method, wherein a card-like 
object corresponds to at least one of a token card and a command card that is not 
associated with a product or contents of a product as taught by Luebbert in order to 
have a simple, economical technique that cannot otherwise be achieved with multiple 
remote-processing inputs (Leubbert paragraph 5). 

7. • Claims 1 1 and 22 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Chen (4,613,942), in view of Se et al. (The International Journal of Robotics Research, 
Vol. 21, No. 8). 

Although Chen discloses all the claimed elements as mentioned in claims 1 and 
12, Chen fails to disclose a method, wherein visually recognizing the indicia further 
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comprises recognizing visual features that correspond to scale-invariant features 
(SIFT). 

Se in the same field of invention discloses using SIFT for image feature 
generation in object recognition applications (section 2). 

From this teaching of Se, it would have been obvious to one having ordinary skill 
in the art at the time the invention was made to modify the method of programming a 
device of Chen to include the SIFT algorithm as taught by Se for the purpose of image 
feature generation in object recognition applications (Se section 2). 
8. Claim 33 is rejected under 35 U.S.C. 103(a) as being unpatentable over Chen 
(4,613,942), in view of Treiber (3,989,929). 

Although Chen discloses all claimed elements as mentioned in claim 23, Chen 
fails to disclose a portion of indicia that are machine readable and a portion of indicia 
that are human recognizable are on different surfaces of an object. 

Treiber in the same field of invention discloses an arrangement to locate a 
machine readable label on the bottom of a package and a human readable label on the 
top of a package (col. 2, lines 15-19). 

From this teaching of Treiber, it would have been obvious to one having ordinary 
skill in the art at the time the invention was made to modify the method of controlling a 
machine of Chen.to include machine readable indicia and human readable indicia that 
are on different surfaces of an object as taught by Treiber in order to control a 
computing system (Treiber col. 2, lines 67-68 and col. 1, lines 1-14). 
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9. Claim 36 is rejected under 35 U.S.C. 103(a) as being unpatentable over Chen 
US (4,613,942) in view of Wuschack (IBM Quality Assurance Operating Procedure, 
Book 1, Volume 03, Subject 109). 

Although Chen discloses all claimed elements as mentioned in claim 35, Chen 
fails to disclose that computer control cards are fabricated from card stock. 

Wuschack in the same field of invention discloses using card stock to produce 
data processing cards (1.1.1, page 1). 

From this teaching of Wuschack, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to modify a set of computer 
control cards of Chen to include fabricating computer control cards from card stock as 
taught by Wuschack in order to produce data processing cards (1.1.1, page 1). 

10. Claims 41, 43-44, 46-47, 49 and 54 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen (4,613,942), in view of Lowe (US 6,711,293 B1). 

Although Chen discloses a module with instructions configured to visually 
recognize indicia that are visible on at least one surface of one or more planar objects, 
where at least one surface of the planar objects includes indicia, where at least a 
portion of the indicia is machine readable and at least a portion is human recognizable 
(col. 4, lines 40-44); a module with instructions configured to automatically associate at 
least some of the recognized indicia with one or more executable program instructions 
(col. 3, lines 29-32); and a module with instructions configured to arrange the one or 
more executable program instructions to create at least a portion of a computer program 
for control of the device (col. 4, lines 45-51); Chen discloses wherein the device 
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corresponds to a mobile robot, wherein at least a portion of the associated behavior 
includes mobility of the mobile robot (Column 3, lines 35-49; Column 5, lines 6-13); 
Chen further discloses the use of a robot (col. 2, lines 61-64). Chen fails to disclose a 
computer program embodied in a tangible medium for controlling a device, instructions 
configured to visually recognize indicia using SIFT, and a circuit for controlling a device. 

Lowe in the same field of invention discloses a computer program embodied in a 
tangible medium for controlling a device (col. 4, lines 39-42 and col. 4, lines 52-53), 
instructions configured to visually recognize indicia using SIFT (col. 1, lines 43-47), and 
a circuit for controlling a device (col. 2, lines 4-5). 

From this teaching of Lowe, it would have been obvious to one having ordinary 
skill in the art at the time the invention was made to modify a computer program of Chen 
to include a computer program embodied in a tangible medium for controlling a device, 
instructions configured to visually recognize indicia using SIFT, and a circuit for 
controlling a device as taught by Lowe in order to address the need for a computer 
vision system to identify scale invariant features in an image and a further method and 
apparatus using such scale invariant features to locate an object in an image (col. 1, 
lines 35-50). 

1 . Claims 51-53 and 55 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Chen (4,613,942). 

Claims 51-53 are just basic coding instructions seen in any computer program. 
The purpose of the cards in Chen is to be able to program the robot as needed to do a 
variety of tasks, therefore, it would have been obvious to one having ordinary skill in the 
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art at the time of the invention to include "break", "repeat", "start", "end", "suspend", 
"move" and "speed" instructions to the robot in order for the robot to be able to perform 
the task needed. 

As per claim 55, Chen fails to specifically disclose wherein the portion comprising 
computer-readable instructions comprises a printed code, however, Chen does disclose 
providing shapes that the system can determine to mean a certain function, therefore 
being a printed code. It would have been obvious to one having ordinary skill in the art 
at the time of the invention to use whatever type of printed code necessary to give the 
robot the necessary tasks it needs to perform. 

Response to Arguments 
1 . Applicant's arguments filed 7/23/07 have been fully considered but they are not 
persuasive. In regard to claims 1,12, 23, 41 , 44, and 47, Applicant argues that Chen 
does not disclose a mobile robot (not just the arm) that can physically move from one 
location to another. Examiner agrees, however, the claim language does not call for a 
mobile robot that can physically move from one location to another. The claims state in 
essence "the device that is controlled corresponds to a mobile robot, wherein control 
includes mobility of the mobile robot." (claim 1) Chen provides a mobile robot, the robot 
arm is capable of being moved and the program controls the mobility of moving the 
robot arm. The claim does not specify that the robot moves between two completely 
different locations, but rather states that it is a mobile robot and the control includes 
mobility of the robot. 
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Further, applicant argues in regard to claim 27 that Chen does not disclose 
"visually observing a plurality of indicia on a plurality of objects" and "arranging the 
plurality of desired behaviors in an order according to a visually observed arrangement 
of the corresponding plurality of objects." Examiner respectfully disagrees. As 
applicant states, Chen discloses a plurality of sheets or cards which are shown in logical 
sequence representing a series of program instructions. Chen discloses arranging the 
plurality of behaviors on the cords in the order that is observed when the cards are put 
in a logical sequence. 

2. Applicant's arguments with respect to claims 35-40 have been considered but are 
moot in view of the new ground(s) of rejection. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Marie A. Weiskopf whose telephone number is (571) 
272-6288. The examiner can normally be reached on Monday-Thursday between 7:00 
AM and 5:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thomas Black can be reached on (571) 272-6956. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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